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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
November 18, 2009 has been entered. 


Response to Arguments 

Applicant's arguments filed November 18, 2009 have been fully considered but 
they are not persuasive. 

1 . Applicant argues, that Suzuki teaches away from providing separate means (e.g., 
motors) for driving each mirror, and instead teaches that mirror adjustment should be 
mechanically linked to a mechanism for adjusting stereo base (lateral distance). And 
that the combination of Zanen and Suzuki would not be obvious because Suzuki 
teaches away from providing "communication means between the stereo adapter and 
the camera, [and] a motor for driving each mirror." 

However, the Examiner notes that neither Suzuki nor Zanen are considered 
to require the use of motors to adjust the mirrors, and that both Suzuki and Zanen are 
considered to adjust the mirrors using a mechanically linked mechanism (Zanen: 
column 4, line 14 - column 5, line 19). And since Suzuki and Zanen are considered 
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adjust the mirrors using a mechanically linked mechanism, the use of a communication 
means between the stereo adapter and camera is not required. Therefore, Suzuki's 
preference to use mechanically linked mechanism instead of a communication means 
between the stereo adapter and the camera is not considered to render the combination 
of Suzuki and Zanen non-obvious. 

2. Applicant also argues that the combination of Robinson and Suzuki would not be 
obvious because Suzuki teaches away from providing "communication means between 
the stereo adapter and the camera", and since Suzuki teaches away from 
communication means between the stereo adapter and the camera, the examiner's 
hypothetical modification of Suzuki to include communication of distance and/or size of 
an object (e.g., according to Robinson) is counter to Suzuki's disclosure. 

However, the Examiner notes that neither Robinson has not been relied upon for 
the use of any communication between the stereo adapter and the camera, but rather, 
Robinson was relied upon to teach the use of analyzing image data of different views to 
match corresponding features and determine focus based on this relationship between 
matched feaures. Therefore, since the Robinson is not relied upon for communication 
between the stereo adapter and the camera, Suzuki's preference to not use 
communication means between the stereo adapter and the camera is not considered to 
render the combination of Suzuki and Robinson non-obvious. 


Application/Control Number: 09/808,377 Page 4 

Art Unit: 2622 

3. Applicant also argues, that Robinson discloses use of a single laser spot for 
distance calculation, and does not teach or suggest extraction of multiple features from 
images and matching of the multiple features across different views. 

However, the Examiner notes that the distance calculation using the laser 
disclosed by Robinson is considered to analyze multiple features that are extracted from 
imags and to match these featues across different views. In support of this, the 
Examiner notes that when the light spot is projected onto an object, it is considered to 
create a "feature" that is present in the image data from each of the separate views, i.e., 
the image data from each view is considered to include a "feature" , wherein the image 
data is analyzed such that each of these "features" is extracted from the different views, 
and by matching these "features" across the different views, the distance to the object 
can be determined (column 2, line 46 - column 3, line 11). Therefore, since Robinson 
discloses that a feature is extracted from the image data of each of the different views , 
multiple features are considered to be extracted and matched across the different 
views. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 
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4. Claims 22 and 32 are rejected under 35 U.S.C. 102(b) as being anticipated 
by Robinson (US Patent 4,751,570). 

5. In regard to claim 22, note Robinson discloses the use of a stereo camera 
system (column 3, lines 21-24) comprising two video cameras (column 3, lines 21-42; 
and figure 2: 22), each camera being angled at an angle relative to each other (column 
3, lines 43-48) and separated by a distance from each other (column 3, lines 43-48) for 
outputting a sequence of stereo video images (column 4, lines 10-13), a recognition 
system which analyzes the stereo video images during operation of the video cameras 
to output the stereo video images to locate an object of interest in a field of view of the 
video cameras and determine the distance to the object of interest from the video 
cameras, wherein said analysis of the stereo video images includes extracting multiple 
features and matching the multiple features across different views (column 2, line 46 - 
column 3, line 1 1 , when the light spot is projected onto an object, it is considered to 
create a "feature" that is present in the image data from each of the separate views, i.e., 
the image data from each view is considered to include a "feature", then the image data 
is analyzed such that each of these "features" is extracted from the different views, and 
by matching these "features" across the different views, the distance to the object can 
be determined), and a controller which, based on input from the recognition system, 
controls a focal length adjustment mechanism which changes a focal length of at least 
one of the two cameras based on the analysis of the stereo video images (column 3, 
lines 49-59, and figure 2: 28), an angle adjustment mechanism which adjusts the angle 
of the video cameras relative to each other based on the analysis of the stereo video 
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images (column 3, lines 15-48, and figure 2: 28), and baseline adjustment mechanism 
which adjusts the distance by which the video cameras are separated based on the 
analysis of the stereo video images (column 3, lines 15-48, and figure 2: 25). 

6. In regard to claim 32, note Robinson discloses the use of a distance adjusting 
mechanism which is controlled by the controller to adjust a distance between at least 
one of the video cameras and the object of interest (column 2, lines 8-18; the use of 
zoom is considered to control the distance between the camera and the object). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. Claims 3-6, 12, 23-24, 30, 33, 34, and 36-39 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Suzuki (US Patent 5,671,450) in view of Zanen 
(US Patent 5,532,777), and further in view of Robinson (US Patent 4,751,570). 

8. In regard to claim 5, note Suzuki discloses a stereo camera system comprising 
stereo imaging means for outputting at least one stereo image (column 1 , lines 5-1 1 , 
and figure 1), said stereo imaging means including a camera (column 4, lines 41-45, 
and figure 1 : 1 ), a set of mirrors angled with respect to each other at an angle relative to 
a centrally located common plane intersecting said camera, each mirror disposed an 
adjustable distance from the camera along the common plane, for directing light from an 
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object reflected in said mirrors along a straight line of sight from said mirrors to the 
camera, for producing a stereo effect in the output of the camera (column 5, lines 15-22, 
and figure 3: 8L and 8R), adjusting means for automatically changing at least one 
system parameter which affects the spatial resolution of the object of interest based on 
the focusing of the camera (column 6, line 49 - column 7, line 1 2; parameters of the 
stereo adapter are adjusted in relation to the focusing of the camera), the adjusting 
means comprising a distance adjustment means for adjusting the distance between the 
camera and the set of mirrors (column 4, line 59 - column 5, line 8, and figure 6; when 
the camera is focused/zoomed, the entire stereo adapter is moved along the optical 
axis), and a focal length adjustment means for changing a focal length of the camera 
(column 4, lines 41-53). Therefore, it can be seen that Suzuki fails to explicitly disclose 
the use of a recognition means for analyzing stereo image data from the camera to 
locate an object of interest in a field of view of the camera and determine at least one of 
a distance of the object of interest from the stereo imaging means and a size of the 
object of interest, wherein said analysis of the stereo image data includes extracting 
multiple features and matching the multiple features across different views, that the 
system parameters are changed based on the analysis of the stereo image data at least 
one of the located distance of the object of interest from the stereo imaging means and 
the size of the object of interest, and that the adjustment means includes an angle 
adjustment means for adjusting the angle of the set of mirrors relative to the centrally 
located plane. 
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In analogous art, Zanen discloses the use of a stereo imaging adapter having 
parameters that are adjusted in relation to the focus amount of the camera (column 5, 
lines 57-67), and the use of an angle adjustment means for adjusting the angle of the 
set of mirrors relative to the centrally located plane (column 6, lines 16-36, and figures 
6-7; the angle between the inner mirrors 16 is adjusted using rod 43 based on the 
focusing of the lens). Zanen teaches that the use of an angle adjustment means for 
adjusting the angle of the set of mirrors relative to the centrally located plane is 
preferred in order to allow for corrections of the field of view (column 5, lines 20-25). 
Therefore, it would have been obvious to one of ordinary skill in the art to modify the 
Suzuki device to include the use of an angle adjustment means for adjusting the angle 
of the set of mirrors relative to the centrally located plane in order to correct of the field 
of view of the imaging device, as suggested by Zanen. 

Also in analogous art, Robinson discloses the use of a recognition means for 
analyzing stereo image data from the camera to locate an object of interest in a field of 
view of the camera and determines the distance of the object of interest from the stereo 
imaging means wherein said analysis of the stereo image data includes extracting 
multiple features and matching the multiple features across different views (column 2, 
line 46 - column 3, line 1 1 , when the light spot is projected onto an object, it is 
considered to create a "feature" that is present in the image data from each of the 
separate views, i.e., the image data from each view is considered to include a "feature", 
then the image data is analyzed such that each of these "features" is extracted from the 
different views, and by matching these "features" across the different views, the 
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distance to the object can be determined), and changing imaging system parameters 
based on the distance of the object of interest from the stereo imaging means (column 
2, line 46 - column 3, line 1 1 ; the determined distance is used to control automatic 
focusing). Robinson teaches that the recognition of an object of interest by analyzing 
stereo image data by extracting multiple features and matching the multiple features 
across different views is preferred in order to accurately detect the object distance, and 
automatically adjust the focus of a stereo camera system (column 2, line 46 - column 3, 
line 11). Therefore, it would have been obvious to one of ordinary skill in the art to 
modify the primary reference of Suzuki as modified by Zanen to include the use 
detection of the distance and/or size of a detected based on the analysis of stereo 
image data by extracting multiple features and matching the multiple features across 
different views from the camera in order to accurately detect the object distance, and 
automatically adjust the focus of the stereo camera system, as suggested by Robinson. 
Consequently, the Examiner notes that since the adjustment of the distance between 
the camera and the set of mirrors disclosed by Suzuki, and the adjustment of the angle 
of the set of mirrors disclosed by Zanen are both controlled based on the focus 
adjustment, by modifying the primary reference of Suzuki as modified by Zanen to 
include the use of focus adjustment based on the detected object distance determined 
from the analysis of stereo image data, as suggested by Robinson, the adjustment of 
the angle of the set of mirrors, distance between the camera and the set of mirrors, and 
the focal length of the camera are considered to be controlled based on the analysis of 
the stereo image data. 
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9. In regard to claim 3, note Suzuki discloses the use of a still camera and the at 
least one stereo image is a still image (column 1 , lines 5-1 1 ). 

1 0. In regard to claim 4, note Suzuki discloses the use of a video camera and the at 
least one stereo image is a sequence of video images (column 1 , lines 5-1 1 ). 

11. In regard to claim 6, note Robinson discloses the use of a controller for 
controlling the focus settings based on the signal from the recognition means (column 2, 
line 46 - column 3, line 1 1 ; the stereo image data is analyzed to detect the light spot 
and determine the object distance and adjust the focus). Suzuki and Zanen control the 
angle, distance, and focal length based on the focus/zoom settings (Suzuki: column 4, 
line 41 - column 5, line 8; Zanen: column 5, line 57 - column 6, line 36). Therefore, 
through the combination of Robinson with Suzuki and Zanen, at least one of the angle, 
distance, and focal length adjustment means are considered to be controlled based on 
the signal from the recognition means. 

12. In regard to claim 12, note Robinson discloses that the recognition means is a 
stereo vision system (column 2, line 46 - column 3, line 1 1 ). 

13. In regard to claim 23, note Suzuki discloses that the mirrors have adjacent ends 
positioned at a common point (column 5, lines 4-22, and figure 3: 8L and 8R). 

14. In regard to claim 24, note Suzuki discloses that the mirrors are disposed for 
directing the light from the object which is reflected in the mirrors directly from the 
mirrors to the camera (column 5, lines 15-22). 

15. In regard to claim 30, note Robinson discloses that the recognition means 
analyzes the stereo image data during operation of the camera (column 2, line 46 - 
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column 3, line 1 1 ; the stereo image data from the camera is used in an auto focus 
routine). 

16. In regard to claims 33, 34 and 36, these are method claims, corresponding to 
the apparatus in claim 5. Therefore, claims 33, 34 and 36 have been analyzed and 
rejected as previously discussed with respect claim 5. 

17. In regard to claims 37 and 38, these are method claims, corresponding to the 
apparatus in claims 23 and 30, respectively. Therefore, claims 37 and 38 have been 
analyzed and rejected as previously discussed with respect claims 23 and 30. 

18. In regard to claim 39, note Suzuki discloses that the focal length adjustment is 
separately adjustable (column 8, line 55 - column 9, line 42; when the zoom lens is 
limited from being adjusted, and driving motors are used to adjust the stereo base and 
the convergence angle, the focal length is considered to be independently controlled), 
and that the distance adjustment means is separately adjustable (column 8, line 55 - 
column 9, line 42; by using driving motors in the stereo adapter to change the stereo 
base and the convergence angle, the zoom can be independently controlled without 
changing the focal length). And Zanen discloses that the angle adjustment means is 
adjusted separately (column 5, lines 20-39, and column 6, lines 48-57; the angle of the 
center mirrors can be adjusted independently of distance adjustment and focus 
adjustment). 
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Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

US005864360A: note the use of comparison between images in order to match 
features for image alignment. 

US005383013A: note the use of comparison between images in order to match 
features for image alignment. 

US007050624B2: note the use of comparison between images in order to match 
features for image alignment. 

US007015951B1 : note the use of comparison between images in order to match 
features for image alignment. 

US005682198: note the use of comparison between images in order to match 
features for image alignment. 

US005740337: note the use of comparison between images in order to match 
features for image alignment. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHRISS S. YODER III whose telephone number is 
(571 )272-7323. The examiner can normally be reached on M-F: 8 - 4:30. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Lin Ye can be reached on (571) 272-7372. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Lin Ye/ 

Supervisory Patent Examiner, Art Unit 2622 


/C. S. Y.I 

Examiner, Art Unit 2622 


